Information-Theoretic Active SOM for Improving Generalization Performance
نویسندگان
چکیده
منابع مشابه
Information-Theoretic Active SOM for Improving Generalization Performance
In this paper, we introduce a new type of information-theoretic method called “information-theoretic active SOM”, based on the self-organizing maps (SOM) for training multi-layered neural networks. The SOM is one of the most important techniques in unsupervised learning. However, SOM knowledge is sometimes ambiguous and cannot be easily interpreted. Thus, we introduce the information-theoretic ...
متن کاملPerformance Guarantees for Information Theoretic Active Inference
In many estimation problems, the measurement process can be actively controlled to alter the information received. The control choices made in turn determine the performance that is possible in the underlying inference task. In this paper, we discuss performance guarantees for heuristic algorithms for adaptive measurement selection in sequential estimation problems, where the inference criterio...
متن کاملDouble Competition for Information-Theoretic SOM
In this paper, we propose a new type of informationtheoretic method for the self-organizing maps (SOM), taking into account competition between competitive (output) neurons as well as input neurons. The method is called ”double competition”, as it considers competition between outputs as well as input neurons. By increasing information in input neurons, we expect to obtain more detailed informa...
متن کاملImproving Generalization Ability through Active Learning
In this paper, we discuss the problem of active training data selection for improving the generalization capability of a neural network. We look at the learning problem from a function approximation perspective and formalize it as an inverse problem. Based on this framework, we analytically derive a method of choosing a training data set optimized with respect to the Wiener optimization criteri...
متن کاملImproving Generalization with Active Learning January
Active learning di ers from passive learning from examples in that the learning algorithm assumes at least some control over what part of the input domain it receives information about In some situations active learning is provably more powerful that learning from examples alone giving better generalization for a xed number of training examples In this paper we consider the problem of learning ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International Journal of Advanced Research in Artificial Intelligence
سال: 2016
ISSN: 2165-4069,2165-4050
DOI: 10.14569/ijarai.2016.050804